Architecture and Experiments in Networked 3d Audio/graphic Rendering with Virtual Choreographer
نویسنده
چکیده
The full integration and synchronization of 3D sound and image requires a data model and an architecture that allow for homogeneous description of geometrical and sonic components, together with mechanisms for distributed and synchronized rendering. First, several modes of sound and graphic combination are examined, and the resulting constraints for the rendering tools are detailed. Virtual Choreographer is then described with a particular emphasis on its XML data model for animation of spatialized geometrical and sonic components. An architecture is proposed that relies on the networked connection of Virtual Choreographer and a tool for sound synthesis and event synchronization such as Pure Data or Max/MSP + SPAT for sound spatialization. Last several experiments that involve these tools for different artistic or technical purposes are presented.
منابع مشابه
A 3d audio-visual animated agent for expressive conversational question answering
This paper reports on the ACQA (Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent (ACA) for conducting research along two main lines: 1/ perceptual experiments (eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head mo...
متن کاملInteracting with 3D Graphic Objects in an Image-Based Environment
This paper presents a novel hybrid rendering system, which allows users to interact with 3D graphic objects in an image-based environment. To represent a complex environment, we use a collection of images captured by a longitudinally aligned camera array, which rotates along a circle. The captured images are indexed and compressed for efficient rendering of the environment. Moreover, users can ...
متن کاملAudio and Visual Rendering with Perceptual Foundations
Realistic visual and audio rendering still remains a technical challenge. Indeed, typicalcomputers do not cope with the increasing complexity of today’s virtual environments, bothfor audio and visuals, and the graphic design of such scenes require talented artists.In the first part of this thesis, we focus on audiovisual rendering algorithms for com-plex virtual environments...
متن کاملA Versatile Software Architecture for Virtual Audio Simulations
Existing real-time audio rendering architectures provide rigid development frameworks which are not adapted to a wide range of applications. In particular, experimenting with new rendering techniques is virtually impossible. In this paper, we present a novel, platform-independent software architecture that is well suited for experimenting with multichannel audio mixing, geometrical acoustics an...
متن کاملA GRASP-Based Algorithm for Solving DVE Partitioning Problem
Graphic cards performance increase and fast Internet connections are popularising Networked Virtual Environments. This immature paradigm of real-time applications has still to solve a set of internal problems associated with the heterogeneity in client-side hardware, network bandwidth and graphic application requirements efficiently. The problem of properly assigning clients (3D avatars) to ser...
متن کامل